By taking the enemy castles, we disrupt their unit production/cumulation and also leave them only with our under-developed towns.